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Capacity  of  Mismatched  Gaussian  Channels 
with  and  without  Feedback 

S.  Ihara* 

Department  of  Mathematics,  College  of  General  Education,  Nagoya  University, 
Nagoya,  464-01  Japan 


Summary.  Continuous  time  communication  channels  with  additive  noise  are 
considered  under  an  average  power  constraint.  The  noises  are  assumed  to 
be  Gaussian  processes  equivalent  (or  mutually  absolutely  continuous)  to 
a  Brownian  motion.  We  study  the  problem  whether  the  capacity  of  the 
channel  is  increased  by  feedback  or  not.  It  is  given  a  sufficient  condition 
under  which  the  capacity  is  not  increased  by  feedback.  It  is  also  given  an 
example  of  a  channel  whose  capacity  is  doubled  by  feedback. 

1.  Introduction 

Whether  the  capacity  can  be  increased  by  feedback  or  not  has  been  studied 
for  various  communication  channels  [4,  7,  13,  19,  20,  25],  Shannon  [25]  showed 
that  while  the  coding  capacity  of  a  discrete  memoryless  channel  with  feedback 
is  equal  to  that  of  the  same  channel  without  feedback,  the  zero  error  capacity 
is  increased  by  feedback.  Kadota  et  al.  [19]  showed  that  feedback  can  not 
increase  the  information  capacity  of  the  white  Gaussian  channel  (WGC).  This 
result  has  been  generalized  by  Hitsuda  and  the  author  [13].  On  the  other  hand 
it  has  been  known  that,  if  a  Gaussian  channel  (GC)  is  with  a  non  white  noise, 
the  capacity  is  increased  by  feedback  (see  [4,  24]).  Moreover  it  was  claimed 
by  Ebert  [7]  and  Pinsker  that  the  capacity  Cf  of  a  GC  with  feedback  is  at 
most  twice  of  the  capacity  C  of  the  same  channel  without  feedback: 

Cf£2C.  (1.1) 

In  this  paper  we  consider  a  continuous  time  GC.  We  give  a  sufficient  condi¬ 
tion  under  which  the  capacity  is  not  increased  by  feedback.  We  also  give  an 
example  of  a  GC  whose  capacity  is  doubled  by  feedback. 

We  are  concerning  the  effect  of  feedback  on  the  capacity  of  a  continuous 
time  GC  presented  by 

Y(t)=j  x(u)du  +  Z(t),  OZt^T,  (1.2) 

o 
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where  *(•)>  T(-)  and  Z(-)  are  the  channel  input,  the  channel  output  and  the 
noise,  respectively.  The  noise  Z(*)  is  assumed  to  be  a  Gaussian  process  given 
by 

Z(r)  =  B(r)+  J  J /(s,  u)  dB(u)ds,  •  (1.3) 

0  0 

where  B(- )  is  a  Brownian  motion  and  /(s,  u)eL2([ 0,  T]2)  is  a  Volterra  function 
(i.e.,  f(s,  u)  =  0  if  s  <  u).  It  is  assumed  that  the  channel  is  with  noiseless  feedback, 
so  that  the  channel  input  x(-)  is  a  causal  function  of  the  message  to  be  transmit¬ 
ted  and  the  channel  output.  The  WGC  is  presented  by 


Y(t)=jx(u)du  +  B(t),  0£t£T,  (1.4) 

o 

and  is  a  special  case  of  the  GC  (1.2).  We  assume  that  an  average  power  constraint 

T 

j£[x(«)2]iu^?r  (1.5) 

o 

is  imposed  on  the  channel  input,  where  P>  0  is  a  constant.  The  definition  of 
capacity  used  in  this  paper  is  the  mutual  information  version,  and  the  capacity 
is  sometimes  called  the  information  capacity.  We  define  the  capacity  as  the 
supremum  of  the  mutual  information  between  the  message  and  the  channel 
output  taken  over  all  messages  and  channel  inputs  satisfying  the  constraint. 

Let  F  and  F*  be  the  integral  operators  on  L2  [0,  T]  with  integral  kernel 
f(s,u)  and  /*(s,  u)=/(u,  s),  respectively,  and  define  a  self-adjoint  operator  S 
by 

S=F+F*+FF *  (1.6) 

It  is  shown  that  if  S  is  non-negative  definite  then  the  capacity  of  the  GC  (1.2) 
subject  to  (1.5)  is  not  increased  by  feedback  and  is  equal  to  PT/2  (Theorem  2). 
Although  it  may  be  expected  that  if  S  is  not  non-negative  definite  then  the 
capacity  is  increased  by  feedback,  we  have  not  succeeded  to  prove. 

To  show  that  the  capacity  is  increased  by  feedback,  we  consider  a  special 
case  of  the  GC  (1.2)  where  the  noise  Z(’)  is  given  by 

Z(t)  =  B{t)-l  je'-’dBWds.  (1.7) 

o  o 

It  is  shown  that,  if  the  power  P  is  equal  to  1/2,  the  per  unit  time  capacity 
of  the  GC  given  by  (1.2)  and  (1.7)  with  feedback  is  at  least  twice  of  that  of 
the  same  channel  without  feedback  (Theorem  3). 

We  should  here  give  cowiUiCuo  o»i  icle.  ani  »otks  ap^cmed  after  this  paper 
was  submitted.  For  the  discrete  time  GC,  Cover  and  Pombra  [5]  proved  the 
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inequality  (1.1)  with  the  aid  of  certain  matrix  inequalities.  The  author  [17] 
showed  that,  for  any  t  >  0,  there  exists  a  discrete  time  GC  for  which  an  inequality 

C/>(2-c)C 

holds.  Note  that  the  noise  process  considered  in  [17]  is  derived  from  a  discrete 
time  approximation  of  the  process  Z(*)  of  (1.7).  Thus  we  can  say  that  the  factor 
two  in  (1.1)  can  not  be  replaced  by  any  other  constants  less  than  two.  In  [3] 
and  [18],  some  conditions  are  given  for  the  discrete  time  GC  under  which 
the  capacity  is  increased  by  feedback. 


2.  Preparation 

Let  £  and  rj  be  random  variables  defined  on  a  probability  space  {Q,  28,  P)  taking 
values  on  measurable  spaces  ( G ,  %)  and  (H,  respectively,  and  denote  by 
/i.  and  the  probability  distribution  of  £  and  the  joint  probability  distribution 
of  £  and  rj,  respectively.  The  mutual  information  I(c,  rj)  between  £  and  rj  is 
defined  by 

J  log (dfi.^dfi^^d/j.^, 

G*H 

if  fi.n  is  absolutely  continuous  with  respect  to  the  product  measure  x  ^  (j*,n 
</i4x^,),  where  dfi^/d^,  x  //,  is  the  Radon-Nikodym  derivative;  otherwise 
/(£,  r\)  is  infinite.  Since  the  measurable  spaces  (G,  S?)  and  ( H ,  jf)  can  be  taken 
arbitrarily,  f  and  rj  may  be  stochastic  processes  as  well  as  finite  dimensional 
random  variables.  The  conditional  mutual  information  /(£,  between  £  and 
rj  given  £  is  defined  by 

/(f.  '?10=JJlog(^{,|^.){x/i,|;)<f//.,Kdpc, 

if  x  /*,!*  a.s.),  where  is  the  conditional  probability  distribution 

of  given  (,  and  pinl:  is  the  conditional  joint  probability  distribution;  otherwise 
/(£,  ^  1 0  is  infinite. 

We  consider  the  GC  presented  by  (1.2)  and  (1.3).  The  Brownian  motion 
B(-)  is  assumed  given  on  (&,  38,  P).  Throughout  the  paper  we  assume  that  the 
feedback  is  instantaneous  and  noiseless.  Precisely  speaking,  the  following  condi¬ 
tions  arc  satisfied. 

(a.l)  The  message  9  to  be  transmitted  is  a  random  variable  defined  on 
(£?,  38,  P),  independent  of  the  channel  noise  Z(’),  taking  values  on  an  arbitrary 
measurable  space  (G,  %). 

(a.2)  x(r)  is  i*(0)v  ^(7)  measurable,  where  !F(8)  (resp.  J^Y])  is  the  er-field 
generated  by  6  (resp.  (7(u);  u<r})  and  ir(0)v  «F,(Y]  is  the  smallest  a-field  con¬ 
taining  &[8)  and  .^(7). 

(a. 3)  The  stochastic  Eq.  (1.2)  has  a  unique  solution  7(*). 

The  Gr  said  to  be  without  feedback,  if  (a.l)  and  toliowing  (a.2]  are  sat¬ 
isfied  : 

(a.2]  x(r)  is  &{9)  measurable. 


456 


S. Ihara 


Denote  by  IT(8,  Y)  =  I(8,  Yf)  the  mutual  information  between  the  message 
6  and  the  output  y0r={y(f);  O^r^T}.  Then,  under  the  constraint  (1.5),  the 
(information)  capacity  C{(P)  of  the  GC  (1.2)  with  feedback  is  defined  by 

C{(P)  =  sup/r(0,  y),  (2.1) 

where  the  supremum  is  taken  for  all  pairs  ( 6 ,  x)  of  a  message  and  an  input 
x(*)  satisfying  (a.l)-(a.3)  and  (1.5).  In  the  same  manner  the  capacity  CT(P )  of 
the  GC  without  feedback  is  defined,  by  taking  the  supremum  in  (2.1)  for  all 
pairs  (6,  x)  satisfying  (a.l),  (a.2')  and  (1.5).  Equivalently,  the  capacity  CT(P )  is 
given  by 

Cr(P)  =  sup  7r(x,  Y), 

X 


where  IT(x,  y)  =  /(xj,  Yf)  and  the  supremum  is  taken  for  all  inputs  x(-)  which 
are  independent  of  Z(*)  and  satisfy  (1.5).  We  are  also  interested  in  the  capacity 
per  unit  time,  under  the  constraint 

I  T 

lim  sup  —  J  £ [x(u)2]  du^P.  (2.2) 

T-x  1  Q 

The  per  unit  time  capacity  Cf(P)  of  the  GC  (1.2)  with  feedback  is  defined  by 

C'(P)  =  sup  f(d,  Y),  (2.3) 

8.x 

where 

T{9,  Y)  =  lim  sup  ^  1T{9,  Y)  (2.4) 

r-x  I 

is  the  per  unit  time  mutual  information  and  the  supremum  is  taken  for  all 
pairs  (8,  x)  satisfying  (a.l)-(a.3),  for  all  7>0,  and  (2.2).  The  per  unit  time  capacity 
C(P)  of  the  GC  without  feedback  is  defined  in  the  same  way. 


3.  Channel  Whose  Capacity  is  not  Increased  by  Feedback 

The  GC  presented  by  (1.2)  and  (1.3)  is  considered  in  this  section.  It  is  well 
known  that  there  exists  a  Volterra  kernel  g(s,  u)eL2([ 0,  T]2),  called  the  resolvent 
kernel  of/(s,  u),  such  that 


f(s,  u)  +  g  (s,  u)  +  J  f(s,  v)  g  (c,  u)dv 


=f(s,  u)  +  g(s,  u)  +  J  g(s,  i ■)/(!?,  u)  d  v  =  0,  s,  ue [0,  T], 


(3.1) 
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(sec  [26]).  Denoting  by  G  the  integral  operator  on  L2[0,  7]  with  g{s,  u)  as  the 
kernel,  (3.1)  means  that 


(/  +  7r)(/  +  G)=(J+G)(7  +  F)  =  I,  (3.2) 

where  1  is  the  identity  operator  on  L2[0,  7].  It  follows  from  (1.3)  and  (3.1) 
that 


I 


Z(0=/7(r,  u)dB(u), 

0 

(3.3) 

5(r)=J  G(r,  u)dZ(u), 

(3.4) 

0 


where  F(t,  u)=l  +  jf(s,u)ds  for  r^u,  F{t,  u)  =  0  for  t<u,  and  G(r,  u)  is  corre- 

II 

sponding  to  g(s,  u)  in  the  same  way  (see  [12]).  Since  (3.3)  is  the  canonical  repre¬ 
sentation  of  Z(-)  in  the  sense  of  Levy-Hida-Cramer,  we  can  apply  a  result 
in  [13]  to  get  a  formula  for  the  mutual  information  in  the  GC. 

T 

Theorem  1.  Suppose  that  J  £[x(u)2]  du<  oo.  Then  the  mutual  information  in  the 
GC  (1.2)  is  given  by  0 

;,(9,r)  =  Jj£[(x0(u)-i„(u))1]i(u,  <>0,  (3.5) 

0 

where  x0  =  (7  +  G)  x,  more  precisely, 

t 

*o(0  =  *(f)+ Jgfo  u)x(u)du,  t> 0,  (3.6) 

o 

and  ^o(0  =  £[*o(0l-^«(y]]  IS  conditional  expectation. 

We  now  can  give  lower  and  upper  bounds  of  the  capadty  and  also  a  sufficient 
condition  under  which  the  capacity  does  not  change  with  feedback. 

Theorem  2  [16].  (1)  The  capacity  of  the  GC  (1.2)  subject  to  (1.5)  is  bounded 
by 


P  Til  <  CT{P)  g  CUP)  £  !!(/  +  F)~ 1 II2  P  77 2,  (3.7) 

where  ]|  •  |j  is  the  operator  norm  of  1}  [0,  7]. 

(2)  If  the  operator  S  defined  by  (1.6)  is  non-negative  definite  (5  ^  0),  then 

CT(P)=  C{-(P)  =  P  7/2.  (3.8) 

Proof.  (1)  The  second  inequality  of  (3.7)  is  clear  by  definition.  For  an  integer 
N,  denote  by  —  ...,A0  the  interval  ((«  —  1)  T/N,  nT/Nj  and  let  8(n),  n 
=  1, ...,  TV,  be  mutually  independent  Gaussian  random  variables  with  mean  zero 
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and  variance  P  Let  0N  =  (0(1),  ...,0(A’))  be  independent  of  Z(-)  and  define  an 
input  xs(-)  by 

xs(t)  =  9(n)  if  teJ„. 

Then  it  is  clear  that  (9S,  xs)  satisfies  (a.l),  (a.2')  and  (1.5).  For  any  £>0,  we 
can  show  that  there  exists  an  integer  Ar  such  that 


JT(9N,Ys)^PT/2-e, 


where  }*(•)  is  the  output  corresponding  to  (9S,  xN).  This  implies  that  the  first 
inequality  of  (3.7)  is  true.  This  inequality  was  also  shown  by  Baker  [1,  2]. 
Let  (9,  x)  be  any  pair  satisfying  (a.l)-(a.3)  and  (1.5).  Define  ,x0(')  by  (3.6)  and 
denote  by  ||*||2  the  norm  of  L2[0,  T].  Then,  using  Theorem  1  and  (3.2),  we 
have 

o 

^  [  l!*o  II 2]  =  i  £  C  li(J  +  G)  x  ||  2] 

^}I|/  +  Cli2£[ii*li2]^±  ||(/  +  F)'1li2££  (3-9) 

The  last  inequality  of  (3.7)  follows  from  (3.9). 

(2)  Since  S  is  a  Hilbert-Schmidt  operator,  if  S^O  then  we  can  easily  show 
that 

||(/  +  F)-,|l2  =  ll(/  +  5)-,|l  =  l.  (3-10) 

The  Eq.  (3.8)  is  straightforward  of  (3.7)  and  (3.10).  □ 


4.  Channel  Whose  Capacity  is  Increased  by  Feedback 


Our  main  aim  is  to  show  that  feedback  increases  the  capacity  of  a  GC  (1.2) 
with  the  Gaussian  noise  Z(*)  given  by  (1.7).  We  consider  the  GC  on  the  time 
interval  [0,  oc)  and  under  the  constraint  (2.2)  with  P—l/2.  We  can  show  that 
the  per  unit  time  capacity  of  the  GC  with  feedback  is  equal  or  greater  than 
twice  of  the  capacity  of  the  same  channel  without  feedback. 


Theorem  3.  Let  Cf(P )  and  C(P )  be  the  per  unit  time  capacity  with  and  without 
feedback,  respectively,  of  the  GC  given  by  (1.2)  and  (1.7)  under  the  constraint 
(2.2).  Then 


and 


(4.1) 

c«)=i. 

(4.2) 

Let  us  outline  how  to  prove  Theorem  3.  To  show  (4.1)  we  construct  a  coding 
scheme  (0,  x),  in  the  following  way,  by  which  mutual  information  T{9,Y)=  1 
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is  transmitted  per  unit  time.  Let  8  be  a  Gaussian  random  variable  independent 
of  Z(-)  with  mean  zero  and  variance  one,  and  ,4(r)  be  a  function  defined  by 


A(()  =  -^=rexp(j  J  g(u)2  du),  rj>0, 

1/2  \  o  / 


(4.3) 


where  the  function  g(t)  is  the  unique  solution  of  the  differential  equation 
2  g'M  =■  -  g  (03  +  g  (0!  + 1/2,  r>0, 

g(°)^. 

The  coding  scheme  of  the  information  transmission  is  given  by 

Y*(t)=iA(u)(e-6(u))du  +  Z(t),  t^O, 


(4.4) 


(4.5) 


where  ff(u)  =  E[8\&u (>'*)].  Then  we  can  prove  the  following  proposition. 

Proposition  1.  (1)  The  stochastic  Eq.  (4.5)  has  a  unique  solution  )’*(•). 

(2)  ^  (r)2  £  [(^  -  <?(r))2] 

O)  m  y*)=i. 

It  is  clear  from  (1)  and  (2)  that  ( 8 ,  x)  satisfies  (a.l)— (a.3)  and  (2.2)  with  P—  1/2, 
where  x(r)  =  ,4(0(0- <?(?)).  Hence  (4.1)  follow  s  from  (3):  C'd/2)  ZT(8,  T*)=  1. 

We  turn  to  the  calculation  of  the  caparity  C(P)  without  feedback.  In  place 
of  the  GC  (1.2)  we  consider  a  slightly  modified  GC  given  by 

t 

Y0(t)=$x(u)du  +  Z0{t),  (4.6) 

o 

where  the  noise  Z0(*)  is  a  Gaussian  process  defined  by 

Z0(r)  =  B(t)—  J  j  e“-’dB(u)ds 

0  -  co 

—  Z (f)  —  J  e~*  £0  d s,  (4.7) 

o 


0 

here  <f0  =  J  dB(u)  and  the  Brownian  motion  has  been  extended  to  a  Gaussian 

—  CO 

process  (B(t);  —  cc<f<oo}  in  such  a  way  that  B(- )  is  with  independent  incre¬ 
ments  such  that  £[(B(r)  — B(s))2]  =  |t  — s|.  It  is  shown  that  the  derivative  Z0(-) 
of  the  process  Z0(-)  can  be  regarded  as  a  generalized  stationary  Gaussian  process 
[10].  Let  Q  be  the  space  of  all  infinitely  differentiable  real  functions  w  ith  compact 
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support  and  £?r=  [4>e&\ supp(d>)c:[0,  T]}.  Precisely  speaking,  the  deri\ati%e 
Z(-)  of  Z(-)  is  defined  by 


Z{<p)  =  ~Z(4>')=  —  f  Z(i)  4>'(t)dt,  <p  6  Q. 

-  X> 


Note  that  if  X (r)  =  J  .v (u)  d u  then  X (4>)  =  *{$)■  It  will  be  shown  in  Lemma  4 


that  Z0(-)  is  a  generalized  stationary  process  with  spectral  density  function 
(SDF) 

*  2 


/(/•)  =  ■ 


(4  8) 


2n(/.-rl) 

Differentiating  the  both  sides  of  (4.6)  we  get  a  generalized  stationary  GC 

W)  =  .*(<5)  +  Z0(P),  (4.9) 


Replacing  IT{d,  V)  in  (2.4)  by 

IT(x,  to )  =  /({.v(<f>);  4>e9r),  (y0(«A);  <A e£?r}), 

defines  the  per  unit  time  mutual  information  /(. t,  y0)  in  the  GC  (4.9).  Denote 
by  C0(P)  the  per  unit  time  capacity  of  the  GC  (4.9)  without  feedback  under 
the  constraint  (2.2).  Using  a  result  in  [23]  we  can  calculate  the  capacity  <T0(1  2) 
and  (4.3)  follows  from  the  following  proposition. 

Proposition  2.  7r  holds  that 

C(4)  =  C0(4)  =  4.  (4.10) 

5.  Proof  of  Propositions 

We  prepare  some  lemmas  to  prove  Proposition  1. 

Lemma  1.  The  unique  solution  g(t)  of  (4.4)  is  given  by 

(g  (0  - 1/2)  (g  W  -  a)*  (s  (0  -  S)'  =  •/  e  -  2*.  t*  0,  (5.1) 

where 

a  =  ( - 1  +  )/7  0/(2  J/2),  0  =  ( - 1/7  +  5  0/(2  j/7), 

7=-(l-l/2a/(l-l/2i/, 

and  i  denotes  the  complex  conjugate  of  a.  Moreover,  it  holds  that 

lim  g(t)  =  j/2. 


(5.2) 
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Proof.  The  roots  of  the  polynomial 


are  j/2,  2  and  2,  and  it  holds  that 

1  1/1 


Q(t) 


-it 


p  P 

+  .J—+. 


■j/2 


2  r  —  a 


Then  it  is  known  that  the  solution  g(t)  of  (4.4)  is  given  by  (5.1).  We  put  <p(t) 
=  arg(g(r)  — 2).  Then  we  have 


(g(0~  z/lgiO- *)  -|g(')-  ‘y|2R*,,’exp(  —  2  Im(fi)  <j>(t)) 


=  lg(0-*l  exp 


l/7 


<f>(0L 


(5.3) 


Since  the  right  hand  side  of  (5.1)  tends  to  zero  as  t-*x,  noting  (5.3)  and  —2 
we  have 


lim(g(r)-j/2)ig(r)-2r,=0. 


This  yields  (5.2).  □ 

Since  the  resolvent  kernel  g(j,  u)  of  the  Volterra  kerne!  /(s,  u)=  — e"'J(s^u) 
is  given  by 

g(5,u)=l,  S^U, 

the  expressions  (3.3)  and  (3.4)  for  the  process  Z(-)  of  (1.7)  turn  to 


Z(r)=Je“-V5(u), 

0 

(5.4) 

I 

B(t)  =  Z(t)+  l  Z(u)du. 

(5.5) 

0 


We  consider  the  following  information  transmission  over  the  GC  given  by 
(1.2)  and  (1.7): 

Y(t)=jA(u)(9-n(u))du  +  Z(t),  (5.6) 

0 
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where  6  is  the  same  random  variable  as  in  (4.5)  and  rj(u)  is  ^U(Y )  measurable. 
We  define  a  function  H{t)  and  processes  ,[(•)  and  U(-)  by 

t 

H(t)  =  A(t)+fA(u)du,  (5.7) 


H(t)  s"(f)  =  ^(t)  r;(i)+  j  A(u)  rj(u)  du. 


U(f)  =  I'(r)  +  f  Y(u)du. 


Using  (5.4),  (5.5)  and  (5.9)  we  can  easily  show  the  following  relations. 


U(r)=  $H(u)(8-;(u))du  +  B(t), 


V(t)= 


It  is  clear  from  (5.9)  and  (5.1 1)  that 


=  t^O, 


(512) 


meaning  1,(6,  Y)^I,(6,  U)  for  all  r  1> 0.  Since  s'(u)  is  J*JY)  =  J'y(lr)  measurable, 
(5.10)  represents  a  WGC  with  feedback.  The  formula  for  the  mutual  information 
in  the  WGC  has  been  known  (see,  e  g.,  [22],  Chap.  16). 

Lemma  2.  The  mean  square  filtering  error  in  the  GC’s  (5  6)  and  (5.10)  is  giien 
by 


£[(0-0(O)2]=(i  +  i  Hiufdu'j  \ 


(5.13) 


where  $(t)  =  E[9\3i(Y)l  V\,6\^,(U)]-  The  mutual  information  is  given  by 


It(6,  Y)  =  I~(d,  U)  =  lj  H(t):E[(6-0(t))2]dt 

o 

=  }  j  H(tf(l  +  j  H(u)2  du)  *  dt. 
o  \  o  / 


(5.14) 


Note  that  the  resulting  mutual  information  does  not  depend  on  rj(-).  Now 
we  can  prove  Proposition  1. 
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Proof  of  Proposition  1.  (1)  Define  processes  U0(')  and  »/(•)  by 

U0(t)=l  H(u)6du  +  B(t), 

'  o 

n(t)  =  El9\j?'(U0)l  (5.15) 


t 


Then  H(t)Z(t)  of  (5.8)  can  be  written  in  the  form  H(t)^(t)  =  J  h(t,  s)  dU0(s)  with 

o 

an  L2-Volterra  kernel  h(t,  s).  It  can  be  shown  ([15])  that  the  stochastic  equation 


l/(t)=  U0(t)—  J  \k(u,s)dU(s)du,  (5.16) 

o  o 

where  k(t,  s)  is  the  resolvent  of  h(t,  s),  has  a  unique  solution 

r  u 

U(t)=u0(t)+  f  J  h(u,s)dl’0(s)du.  (5.17) 

o  o 


In  other  words,  (5.10)  has  a  unique  solution  U(-)  when  H(u)^(u) 

y  y 

=  }  h(u,  s)dl’0(s)  =  J  k(u,  s)dl’(s).  Since  there  is  one-to-one  correspondence  be- 

O  0 

tween  (5.6)  and  (5.10),  this  means  that  (5.6)  has  a  unique  solution  T(-)  when 
rj(’)  is  given  by  (5.15).  From  (5.16),  (5.17)  and  (5.12)  we  see  that  S^,(U0)  =  ^i(U) 
=  ^(Y)  and  that  rj(t)  =  E[9\^,(U0)]  =  Eldl^KY)].  Thus  (4.5)  has  a  unique  solu¬ 
tion  ¥*(■). 

(2)  It  follows  from  (4.4)  that 


^  jg(r)exp^  J  g(u)2dujj 


=  (g'(0+kg(r)3)explj  J  g(u)2du 
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Therefore,  noting  (5.7)  and  the  initial  condition  g(0)  =  .4(0)=  l/j/2,  we  obtain 

H(t)  =  A(r)  +  J  /4(u)du  =  g(r)exp(i  j  g(u)2du), 

0  \  0  / 

#  W3  =  g(:)2  exp  ^  J  £  ("):  =  ^  exP  ( 1  ^  (“)2  ^ 


(5.18) 


ind 


1  +  J  H  (u)2  du  =  exp  ^  g  (u)2  d  uj .  (5. 1 9) 

The  desired  equation  is  straightforward  of  (4.3),  (5.13)  and  (5.19). 

(3)  It  follows  from  (5.18),  (5.19)  and  (5.2)  that 

lim  H(T)2l  1  + J  H(u):du)  ’=  lim  g(T)2  =  2. 

r-x  \  o  /  T-x 


Hence,  by  Lemma  2,  we  get 


m  t*)=  lim  ~iT(e,r-) 

r-x  1 

=  lim  -^=  J  //(u)2(l  +  J  (5)2  ds)  '  du 

r-*  4  /  0  \  o  / 

=  lim  iH(T)2(l  +  J /f(5)2d5)  ‘  =  1.  □ 

\  o  / 

We  prepare  two  lemmas  to  prove  Proposition  2. 

Lemma  3.  Let  jc(-)  be  an  input  independent  of  B(’),  and  T(-),  yo(*)  an d  Yo(') 
be  the  corresponding  outputs  of  the  CC's  (1.2)  (with  the  noise  Z(-)  given  by  (1.7)), 
(4.6)  and  (4.9),  respectively.  Then 


It(x,Y0)  =  Jt(x,Y0\  TZO,  (5.20) 

and 

T(x,Y)  =  T(x,Y0)  =  T(x,Y0).  (5.21) 

Proof  Using  the  same  arguments  as  in  [11],  (5.20)  can  be  shown.  The  second 
equality  of  (5.21)  is  clear  from  (5.20).  To  show  the  first  equality  oi  (5.2  i)  we 

put 

{(s)=  jVd5(u),  5  =  0, 
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which  are  independent  of  c0  =  J  eu dB(u).  Note  that  the  conditional  mutual 
information  satisfies 

I{C,  (rj,  0) = ]  (c,  0 + /(c,  n  1 0 = 1  (c,  n) + J  (c,  Cl  n)- 
Denoting  I r(x,  y|<f)  =  /(.xj,  V0T|c)  and  7r(x,  £|  y)  =  7(xj,  c|y0T),  we  have 

lT(xAYo,Co))=h{x,£o)JrIAx,yo\co)  =  IAx,Y) 

I t(x>  ( Yo >  Co))  =  jt(x,  V0)  +  /r(x,  c0|  yo), 
and  consequently 

lj(x,  Y)  —  lj(x,  Y0)  =  It(x,  Co)  Y0).  (5  22) 

In  the  same  way  we  have 

7r  (-N  Co !  ^o)~ H((X’  Yq).  c0)-Ir(Y0,  {0) 

—  1t(x’  Co)-*"  Hi Yo,  Co  I*)-  HiYo,  £o) 

—  H(Zo<  Co)  -  Hi  Yo,  Co)  iC  It(Z0,  £ o)-  (5.23) 

Noting  (4.7)  we  can  calculate  1T(Z0,  <f0)  by  use  of  (5.14): 

Mz«.  W-H  jD  *  - }  to* (t + ^. 

Therefore, 

lira  ■=:  Ij{Z0,  <fo)  =  0.  (5.24) 

T-  i  i 

The  first  equality  of  (5.21)  follows  from  (5.22),  (5.23)  and  (5.24). 

Lemma  4.  The  process  Z0(')  is  a  generalized  stationary  Gaussian  process  with 
covariance  functional 

£[ZO(0)2O( *)]«  J  <p(t)ip{t)dt 
-  ® 

-i  f  f  e"l'",|<^(s)^(f)^sdr,  (5.25) 

-  X  -  90 

and  with  SDF  /(/)  of  (4.8),  namely 

E[ZQ(4>)Z0m=  J  ?{>.)W)fWd>,  (5.26) 

-  ec 

ao 

where  $(/.)  =  J  e 4>{t)  dt  is  the  Fourier  transform  of  <p. 
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Proof.  We  put 

C(t)=  j  J  S-'dB(u)ds, 

0  -  oc 

for  simplicity.  Then  Z0(r)  =  B(r)  —  £(f)  and 

Zo(0)=B(^)-C(0),  4>e®.  (5.27) 

It  is  well  known  that 

ElB{<j>)Bm=  J  <j>(t)iHt)dt,  4>,4>e2  (5.28) 

—  X 

(see  [16]).  Exchanging  the  order  of  the  ordinary  integrals,  the  Wiener  integrals 
and  the  expectations,  we  can  show 

£[BU>KW)]=  f  i  0(s)<Mr)dsdf,  (5-29) 


£[^)^)]-i  J  \  e-'1-*' <Hs)f(t)dsdt,  (5.30) 

—  a>  —  oc 

by  elementary  calculation.  We  can  derive  (5.25)  from  (5.27H5.30).  Denote  <p,(t) 
=  4>(t  —  x).  Then  it  is  clear  from  (5.25)  that 

£[Z0(<*g  Z0(<At)]  =  E  [Zotf)  ZoWl 

meaning  that  the  process  Z0(‘)  is  stationary.  Since 

2~  J  $(/.)$(/.)()*  + 1)~ 1  d* 

~~  X 

=  2~  J  I  J  0(s)^(O«'<,‘,M('-2  +  l)~l  d/.dsdt 

—  X  “  X  —  00 

-i  f  f  e-1'-*' <^(s)^(r) 

-  x  -  X 

(5.26)  follows  from  (4.8)  and  (5.25).  □ 

We  are  now  in  a  position  to  prove  Proposition  2. 

Proof  of  Proposition  2.  It  is  clear  from  (5.21)  that 

C(P)  =  CQ(P). 


(5.31) 
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Let  Rt  be  the  covariance  operator  of  the  process  Z0(-)  on  the  interval  [0,  T], 
namely  an  operator  on  LJ[0,  T]  such  that 

0  0  0 

<^eL3[0,T], 

where  ( v)r  is  the  inner  product  of  L 2  [0,  T].  Denote  by  KT  the  integral  operator 
on  L2[0,  T]  having  1  /2e~l'~3i  as  the  integral  kernel.  Then  RT  =  1  ~  KT,  where 
1  is  the  identity  operator.  We  can  show  that  the  eigenvalues  {k'„(T)}  of  KT 
are 

f.(T)»(l  +  c.(T)Jr'.  n  =  1, 2, 

where  oK  =  c„(T)  is  uniquely  determined  by 


tan  ((n  -  -  c„  T)/2)  =  a„,  {n-\)n<c„T  £nn. 

The  corresponding  eigenfunctions  {£>„(/)  =  &„(r;  T)}  are  given  by 

<^,(0  =  exp (1^0 -7— —  exp(  —  /crnr),  n  =  1,2, ...  . 

Therefore  the  eigenvalues  {/. „(T )}  of  Rr  are 

UT)=i-Knm=cAT)2(i+<?jT)2r',  n~  1,2 . 

Let  Cr(P)  be  the  capacity  of  the  GC  (4.9)  without  feedback,  on  the  finite  interval 
[0,  F],  subject  to  (1.5).  Then  it  is  known  that 

CT(n=i  I  log  4^.  (5  32) 

.-1  A»(T) 

where  a  positive  constant  A  =  A(T,  P)  and  an  integer  N  —  S(T,  P )  are  uniquely 
determined  by 


£(A-;.AT))  =  PT  and  N  =  wax{n;  ;.„(T)<Aj. 

n  *  1 

It  can  be  shown  that 


1 

2 


T 


I 

"  *  l 


1  ,  1 
k*(T)<  y+y- 


Hence  we  know  that 


lim  A7(Ti)  =  oc,  lim  A{T,\)=\. 

T—  ac  7  —  x 


(5.33) 
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It  follows  from  (5.32)  and  (5.33)  that 


lim  ~  Cr(])  =  Iim  —  Y  log ~  - 

t~x>  T  *ln{T) 


-  Hm  —  j  log(I  +  7t“2  T2x~2)  dx 
t-x  2  J  j 

=  lim  —  J  log(I  +x~2) dx  =  }. 

T~x  2  11  r/T 


We  can  also  show  that 


,•  1  -  ,,  ,1  £ 

hm  —  Cr(}  +  £)  =  -  +  -, 

r-x  J  2  2 

for  every  £>0.  Therefore,  for  any  £>0  and  any  input  signal  *(•)  satisfying 
(2.2)  with  P=  1/2,  there  exists  T0  such  that 

jh(x,Y)£jCT(l  +  c)gl  +  c,  TZT0. 


Since  t  is  arbitrary,  we  conclude  that 

c0mt- 


(5  34) 


Let  an  input  signal  .*(•)  of  the  GC  (4.9)  be  a  mean  zero  stationary  Gaussian 
process  with  SDF 

J 


Since 


*W-2«W+1  )• 

£[*W2]  =  J  h(/.)d/.  =  $,  -  cc  <r  <  x, 


the  input  AT-)  satisfies  (2.2)  with  P-l/2.  Since  the  SDF  h{/.)  is  rational,  we 
can  apply  the  Pinsker’s  formula  ([23],  Theorem  10.3.1)  to  get 


J  iog(j 

—  X 

Therefore,  we  have 

C0(t)*T(x,  T)=i. 

Combining  (5.31),  (5.34)  and  (5.36)  we  have  (4.10).  □ 


(5.35) 


(5.36) 
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<S.  Remarks 

There  is  a  well  known  formula  for  the  capacity  C(P)  of  a  stationary  GC: 

C(p)=47i,0SM"'  <6I) 

where  /(/.)  is  the  SDF  of  the  noise  process,  A  =  {Z; /().)<  A}  and  the  constant 
A  is  determined  by 


S(A-fV.))dX  =  P 

A 

(see,  e.g.,  [8],  Theorem  5.26;  [9],  Theorem  8.5.1).  We  have  not  applied  the  formu¬ 
la  (6.1)  to  calculate  the  capacity  of  the  GC  (4.9),  since  the  noise  is  not  an  ordinary 
process  but  a  generalized  one.  However,  the  resulting  capacity  C0(l/2)=l/2 
is  equal  to  the  right  /and  side  of  (6.1)  with  /(/.)  of  (4.8)  and  P=  1/2. 

In  the  same  manner  as  in  the  proof  of  Theorem  3,  we  can  derive  a  lower 
bound  for  the  capacity  Cf{P)  of  the  GC  of  Theorem  3.  Let  */(?)  be  the  unique 
solution  of  the  equation 


Then 


a3-P(x+l)2  =  0. 


C'(P)Zy(P). 


It  is  conjectured  that,  for  the  GC  of  Theorem  3,  the  inequality 

C'(P)Z2C(P) 


(6.2) 


holds  only  if  P=  1/2. 

We  note  that  the  process  Z(-)  of  (1.3)  is  equivalent  (or  mutually  absolutely 
continuous)  to  a  Brownian  motion  on  each  time  interval  [0,  7]  ([12]).  Denote 
by  ||  •  II r  the  norm  of  the  reproducing  kernel  Hilbert  space  corresponding  to 
=  0  £t^T).  Then  the  constraint  (1.5)  can  be  written  in  the  form 

EBxlfflZPT,  (6.3) 

t 

where  X{t)=  J  x{u)du.  Since  the  constraint  (1.5)  or  (6.3)  is  given  in  terms  of 
o 

B(‘)  and  not  of  the  channel  noise  Z(*),  the  GC  (1.2)  subject  to  (1.5)  is  called 
a  mismatched  GC  (see  [1,  2]).  On  the  other  hand  the  WGC  (1.4)  is  to  be  a 
matched  GC  under  (1.5).  In  this  paper  we  have  treated  GC’s  with  noises  equiva¬ 
lent  to  a  Brownian  motion.  This  is  rather  for  technical  reasons.  We  can  investi¬ 
gate  a  matched  or  a  mismatched  GC  with  an  arbitrary  Gaussian  noise  [1,  2,  13]. 
Baker  [1,  2]  has  determined  the  capacity  of  the  mismatched  GC  without  feed¬ 
back.  It  has  been  shown  that  the  capacity  of  the  matched  GC  is  not  changed 
by  feedback  under  a  moderate  assumption  on  the  Gaussian  noise  [13].  Theo¬ 
rem  2  may  be  generalized  by  using  a  similar  method  as  in  [13]. 


Ebert  [7]  claimed  that  the  inequality  (1.1)  holds  for  the  GC  (1  2}  subject 
to  (2.2),  under  an  assumption  that  the  Volterra  kernel  f  (s,  u)  is  a  function  of 
s-v.  If  the  inequality  (1.1)  is  true  for  the  continuous  time  GC,  the  feedback 
capacity  Cf(  1/2)  of  the  GC  of  Theorem  3  would  be  equal  to  one,  twice  of  the 
capacity  <T(l/2)=l/2  without  feedback,  and  the  coding  scheme  given  by  (4.5) 
would  be  optima]  in  the  sense  of  attaining  the  capacity.  We  recall  that,  for 
the  WGC,  a  coding  scheme  given  in  the  same  manner  as  (4.5)  is  optimal  [14]. 

In  this  paper  we  have  dwelled  only  on  information  capacity.  In  case  o. 
discrete  time  GC,  Cover  and  Pombra  [5]  proved  the  inequality  (1.1)  for  the 
information  capacity,  2nd  showed  that  the  information  capacity  is  achievable 
by  a  feedback  code.  This  means  that,  in  case  of  discrete  time  GC,  the  information 
capacity  Cf{P)=  C{a!(P)  per  unit  time  is  equal  to  the  coding  capacity  (Tco<J(P). 
For  the  continuous  time  GC  with  feedback,  as  far  as  1  know,  such  an  equality 
has  not  been  established.  However  we  can  show'  that  the  lower  bound  y(P) 
for  the  capacity  C*{P)  (see  (6.2))  of  the  GC  of  Theorem  3  is  achievable  by  a 
feedback  code,  meaning  that  ‘,{P)^.C{oi{P)^€{nl(P).  For  the  capacity  without 
feedback  we  refer  [6,  9,  21]. 

Ackr.^H  ’.edgement.  The  author  wishes  10  express  his  sincere  thanks  to  Professor  C  R  Bake:  for  valuable 
discussions. 
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